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POSITIVE MAPS AND SEPARABLE MATRICES 


JIAWANG NIE AND XINZHEN ZHANG 


Abstract. A linear map between real symmetric matrix spaces is positive if all 
positive semidefinite matrices are mapped to positive semidefinite ones. A real 
symmetric matrix is separable if it can be written as a summation of Kronecker 
products of positive semidefinite matrices. This paper studies how to check if a 
linear map is positive or not and how to check if a matrix is separable or not. 
We propose numerical algorithms, based on Lasserre’s type of semidefinite 
relaxations, for solving such questions. To check the positivity of a linear 
map, we construct a hierarchy of semidefinite relaxations for minimizing the 
associated bi-quadratic form over the unit spheres. We show that the positivity 
can be detected by solving a finite number of such semidefinite relaxations. To 
check the separability of a matrix, we construct a hierarchy of semidefinite 
relaxations. If it is not separable, we can get a mathematical certificate for 
that; if it is, we can get a decomposition for the separability. 


1. Introduction 

For an integer fc > 0, denote by the space oi k x k real symmetric matrices, 
and denote by the cone ot k x k real symmetric positive semidefinite matrices. 
For A G by A ^ 0 we mean that X G S^. 

1.1. Positive maps. Let p,q be positive integers. A linear map 

$ : ^ 59 

is said to be positive if <1>(A) G <S^ for all A G S^. An important problem in 
applications is checking whether or not a linear map is positive. It is well-known 
that checking positivity of linear maps is equivalent to detecting nonnegativity of 
bi-quadratic forms (cf. Choi [4]). As in [4], one can show that $ is a positive map 
if and only if 

B{x, y) := y^^{xx^)y >0 Vx G y G K'^. 

The above B{x,y) is a bi-quadratic form in two groups of variables 
X := (xi,...,Xp), y := {yi,...,yg). 

Let Eik be the symmetric matrix in whose (*,/c)th and (fc,*)th entries equal to 
one and all other entries are zeros. Denote 

(1.1) D := {(*, j,k,l) : l<i<k<p, l<j<l< q}. 

Then, we can expand B(x,y) as a polynomial in {x,y): 

( 1 . 2 ) y'^^{xx'^)y = y'^(^ ^ XiXk^{Eik)jy = ^ hjkiXiyjXkyi, 
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where each bijki = {^{Eik))+ {^[E^k))^y The coefficients hijki are uniquely 
determined by the linear map 3>, i.e., $ uniquely determines the array 

(1-3) ^ {^ijkl')(i,j^k,l)^Q7 

and vice versa. The array B can be thought of as a vector in the space Denote 
by the set of all positive linear maps from to S‘^. The set is a 

closed convex cone, which can be implied by Proposition 3.2 of [27]. A goal of this 
paper is to check the membership in This question is related to bi-quadratic 

optimization, which was studied in Ling et al. Recently, Kellner et al. [T5] 

have important work on positive maps and the set containment problem, and have 
proposed semidefinite relaxation methods. 

Positive maps have applications in Mechanics. In elasticity theory, an elasticity 
tensor can be represented by an array B as in dia, which determines the linear 
map $ as in (11.21) . It is said to satisfy the Legendre-Hadamard condition |3] if 

B{x,y)>0 VxeRP, VyeRA 

Such map is also said to be elliptic. Moreover, the elasticity tensor is said to be 
strongly elliptic if B{x,y) > 0 for all a: 0 and y ^ 0. Clearly, the Legendre- 
Hadamard condition is satisfied if and only if the associated linear map is positive. 
Similarly, it is strongly elliptic if and only if B(x, y) is strictly positive on the unit 
spheres ||a :||2 = II 2 /II 2 = 1 (II • II 2 denotes the standard 2-norm.) The Legendre- 
Hadamard condition and strong ellipticity play important roles in elasticity theory. 
We refer to [Ilia [3] and the references therein. 

1.2. Separable matrices. The cone dual to the positive map cone also has 
important applications. It is the cone of so-called separable matrices. For two 
matrices B G Sp and C G .S'?, B ®C denotes their Kronecker product, i.e., B ®C 
is the block matrix 

B<^C:= 

Let .yfP'^ be the subspace spanned by all such Kronecker products: 

(1.4) = span {B®C : B G , C G S‘^} . 

The set is a proper subspace of 5?’'?. Its dimension is not p^q'^{p^q^ + l)/2, 

but instead 

dim = ^p(p + 1 ) 9(9 + !)• 

Each A G is uniquely determined by the array 

in the way that 

(1-b) A(j^_i-^qj^j^(^k — l)q+l ^ijkl ^(b 9)^.0 ^ 

As in Dahl et al. |6], a matrix A G is said to be separable if there exists 

Bj G S^,Cj G (j = 1,L) such that 

(1.6) A = Bi (8) Cl -l- ■ ■ • Bl 0 Cl- 

The equation (11.611 is called an S-decomposition of A. Let A^P’I be the cone of all 
such separable matrices: 

L 

:= { XI ^0 ® G : each Bj G 5^ G G 5^ A G n} . 

i=i 


(1.7) 
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The cones and are dual to each other (cf. Prop. [2T]l . 

In quantum information theory, an important problem is to check if a quantum 
system is separable or entangled (cf. [5]). A quantum system can be represented 
by a density matrix, which is positive semidefinite and has trace one. Thus, a 
quantum system is separable (resp., entangled) if its density matrix is separable 
(resp., not separable). Checking whether or not a density matrix is separable needs 
to detect the separability/entanglement. To do this, approximation methods were 
proposed in [ing, by solving a sequence of bi-quadratic optimization problems. 
Typically, it is difficult to check separability. Indeed, the weak membership problem 
for separable matrices is NP-hard, as shown by Gurvits [lOj . 

1.3. Contributions. In this paper, we propose new methods for checking positive 
maps and separable matrices. 

Checking positivity of a linear map $ is equivalent to checking nonnegativity of 
the associated bi-quadratic form B{x,y). So, Lasserre’s hierarchy of semidefinite 
relaxations (cf. [16) 1 can be applied to solve the question. Under some optimality 
conditions, Lasserre’s hierarchy was proved to have finite convergence (cf. [24) 1. For 
convex polynomial optimization, Lasserre’s hierarchy also has finite convergence, 
under the strict convexity or sos-convexity assumption (cf. [7l|T^). An improvement 
of Lasserre type relaxations is proposed in m- For checking positive maps, a 
sufficient criteria was given in m-, some convex relaxations were proposed in Ell- 
Such earlier existing relaxations may not be tight for checking positivity of some 
linear maps. For this reason, this paper proposes a new hierarchy of semidefinite 
relaxations (cf. Ij3]). We prove the following property for it; for every linear map, 
its positivity can be detected by solving a finite number of semidefinite relaxations 
contained in this new hierarchy. For checking positivity of linear maps, this is the 
first type of semidefinite relaxations possessing the aforementioned property, to the 
best of the authors’ knowledge. 

Checking separability of a matrix is equivalent to checking whether or not it has 
an S-decomposition as in dUl). For recent work on entanglement or separability, 
we refer to [6l|9lll0l[n]. Most earlier existing work can detect inseparability if the 
matrix is not separable. However, if the matrix is separable, these work usually 
cannot detect the separability, because an S-decomposition is often lacking. To 
check separability, we show that the question is equivalent to a truncated moment 
problem with special structures. To solve it, we construct a hierarchy of semidefinite 
relaxations. If the matrix is not separable, we can get a certificate for that. If it is, 
we can get an S-decomposition. To the best of the authors’ knowledge, this is the 
first work that possesses this property. 

The paper is organized as follows. Section [2] presents some preliminaries in 
the field of polynomial optimization, moments, and duality of positive maps and 
separable matrices. Section [3] discusses how to check if a map is positive or not. 
Section ID discusses how to check whether a matrix is separable or not. Last, we 
present some numerical examples in Section (5) 

2. Preliminaries 

Notation The symbol N (resp., R, C) denotes the set of nonnegative integral (resp., 
real, complex) numbers. Let p, q be positive integers. Denote the variables 

X := y :={yi,...,yg). 
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Denote the p-dimensional vector of all ones by Ip. For convenience, denote 

{x,y) = (a;i,...,Xp, yi,...,yq). 

Let M[a;,y] be the set of all monomials in {x,y) and 

R[x,y] :=R[xi,...,Xp,yi,...,yg] 

be the ring of real polynomials in {x,y). For d > 0, (resp., ]R[a;,?/]d) 

denotes the set of all monomials (resp., polynomials) with degrees at most d. For 
a set F" C ]R[a;, y] and a pair (u, v) gW’ x the notation 

[iu,v)]F 

denotes the vector of all polynomials in F evaluated at the point {u,v). In partic¬ 
ular, denote 

(2-1) [{u,v)]d:=[{u,v)]M[x,yU- 

It can be counted that the dimension of the vector [(rt, v)]d is {^~^d^'^), the cardinal¬ 
ity of the set M[[a;,y]d. For t, [t] denotes the smallest integer that is greater than 
or equal to t. 

2.1. Sum of squares and positive polynomials. Let h := {hi,... ,hs) be a 
tuple of s polynomials in ]R[x,?/]. Denote by I{h) the ideal generated by h: 

I{h) = hi • ]R[a;, y] + ■ ■ ■ + hs ■ R[a;, y] ■ 

In practice, we need to work with a finitely dimensional subspace in I{h). We 
denote the N-th truncation of I{h) as 

(2.2) I]\j{h^ .= hi • ]R[x, y] A—deg(^ii) -t- * * * -t- • M[x, y] a— deg(^is) ■ 

A polynomial a is said to be sum of squares (SOS) if a = ff + ■■■ + for some 
real polynomials /i,..., /fc. The set of all SOS polynomials in {x, y) is denoted as 
S[a;,y]. For a degree D, denote the truncation 

S[a;,y]n := S[a;,y] nR[a;,y]D. 

It is a closed convex cone for all even D > 0. The symbol mf(S[a;, yju) denotes 
the interior of S[a;, yji). For a tuple g ■= {gi,, gt) of polynomials in ]R[a;, y], the 
quadratic module generated by g is the set 

(2.3) Q{g) := E[a;,y] + gi ■ S[a;,y] H-h fft • S[a;,y]. 

The k-th truncation of Q{g) is the set 

(2.4) Qk{g) := i:[x,y] 2 k+gi ■ ^x,y] 2 k-deg{gi) H-^ 5t • S[x, y]2fe_deg(gt)' 

Let h and g be the polynomial tuples as above. Consider the set 

(2.5) S = {(u,f) £ X : h{u,v) = 0, g{u,v) > 0}. 

Clearly, ii f € I{h) + Q{g), then / is nonnegative on S. Interestingly, the reverse is 
also true under some general conditions. The set I{h) + Q{g) is called archimedean 
if there exists (j) £ I{h) + Q{g) such that (j){x,y) > 0 defines a compact set in 
the space x R^. When I{h) -\- Q{g) is archimedean, Putinar proved that 
if / £ R[a;,y] is positive on S then / £ I{h) + Q{g). Moreover, as shown recently 
in [24], if / is nonnegative on S and satisfies some general optimality conditions, 
then we also have / £ I{h) + Q{g). We refer to Lasserre’s book [18] and Laurent’s 
survey [20] . for additional information on polynomial optimization. 
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2.2. Truncated moment problems. Let space of vectors indexed 

by monomials in the set M[[a;,y](i. A vector in is called a truncated multi¬ 
sequence (tms) of degree d. For a tms w G we can index it as 

^ ('^x^y^)x^y^GM[x,y]d' 

Define the scalar product between K[a;,y]d and such that 

(2.6) ^ ^ Ca,/3a;“y^, := ^ Ca^pw^cyP, 

\a\ + \P\<d |a| + l/3|<d 

where Ca,p are the coefficients. The tms w is said to admit a representing measure 
whose support is contained in a set T if there exists a Borel measure /i supported 
in T (i.e., supp(/i) C T) such that 


w 


a 



Vo e M[a;,y]d. 


If so, such ^ is called a T-representing measure for w and we say that w admits 
the measure fj,. An interesting question is how to check whether a tms admits 
a T-representing measure or not. The method in [5^ can be applied to do this. 
Note that this problem is not polynomial optimization. The classical Lasserre’s 
relaxations in m for polynomial optimization is not very suitable for solving the 
question. 

Let 9 G K[a;,y] 2 fc with deg(0) < 2k. The k-th. localizing matrix of 6, generated 
by w G jg ^]^g symmetric matrix Lf^\w) satisfying (see (12.61) for (,)) 

vecifi)'^ (^Lf\w)^vec{f2) = {0fif2,w) 
for all /i, /2 G R[a;, y] with 

deg(/i),deg(/ 2 ) <k - [deg(6»)/2]. 

In the above, vec{fi) denotes the coefficient vector of the polynomial fi. When 9 = 1 
(the constant polynomial 1), L^^\w) is called a moment matrix and is denoted as 

(2.7) Mu{w):=L^^\w). 

The columns and rows of Lg^\w)., as well as Mk{w), are indexed by monomials 
a G M[x,?/] with deg(6(a^) < 2k. 

Let S be as in (|2.5I) . If w admits an S'-representing measure, then (cf. [511^1 

(2.8) 4^^(zc)=0(l<z<s), L<~J;Hw)hO{l<j <t), MkHhO. 

The reverse is typically not true. For convenience, denote 

f H,..., (w)), 

In the above, diag(Ai,... ,Xr) denotes the block diagonal matrix whose diagonal 
blocks are Xi ,..., A^. Let do = maxjl, |'deg(h)/2], |’deg(5)/2]}. If w satisfies (12.81) 
and 


(2.10) rankMfc_do(ui) = rank Mk{w), 

then w admits an S'-representing measure (cf. [51 [55]). When (12.81) and (I2.I0|) hold, 
the tms w admits a unique representing measure y, on R"; moreover, the measure 
p, is supported on r := rankMfe(?z;) distinct points in S. The points in supp(^) can 
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be found by solving some eigenvalue problems |14) . For convenience, we say that 
w is flat with respect to h = 0 and g > 0 if (j2.8ll and (j2.10|) are both satisfied. 

For two tms’ w G RM[a:,y] 2 fc ^ g k < I, wB say that w is a 

truncation of z, or equivalently, 2 ; is an extension of w, if Wq = for all a G 
M[a;, 2 /] 2 fc- Denote by z\d the subvector of 2 ; whose entries are indexed by a S 
M[a;, 2 /]c;. Thus, w is a truncation of z if z| 2 fc = w. Throughout the paper, if 
z\ 2 k = w and w is flat, we say that re is a flat truncation of z. Similarly, if z| 2 fc = w 
and z is flat, we say that z is a flat extension of w. Flat extensions and flat 
truncations are proper criteria for checking convergence of Lasserre’s hierarchies in 
polynomial optimization (cf. [23)1. 

2.3. Properties of and The positive map cone and the separable 

matrix cone can be thought of as subsets of the vector space R^, for D as in 

(11.11) . For B G and A G A^P’‘>, we can index them as 

B = {biji^if2,j,k,l)GQ: A = {^aijklfi^jk,l)BiGl' 

Define their inner product in the standard way as 

{A^ B^ .— ^ ^ aij}^ih'ij]^i. 

The standard definition of dual cones is used in the paper. A cone C is said to be 
pointed if C H —C = {0}, and it is said to be solid if it has nonempty interior. 

Proposition 2.1. The cones tAP’’^ and ^P’I are proper (i.e., closed, convex, 
pointed, and solid), and they are dual to each other, i.e., 

(2.11) 

The convexity of t^P^^ are straightforward. As in [6l Theorem 2], it holds that 

S^P’i = conv{(a; ® y){x ® y)'^\x G R^, y G R"^}. 

(The conv denotes the convex hull.) So, we can get the convexity of The 

polynomial {x'^x){y'^y) G is strictly positive on the bi-sphere ||a ;||2 = || 2/||2 = 1- 
The set A^P’'^ is the cone of truncated multi-sequences in R^ that admit representing 
measures supported on the bi-sphere ||a :||2 = II 2 /II 2 = 1- Hence, the closedness, 
pointedness, and solidness of the cones and A^P'^, as well as the duality 

relationship (I2.11L can be implied by [27l Prop. 3.2]. We refer to [11] for related 
work on positive maps and separable matrices. 

3. Checking positive maps 

This section discusses how to check whether a linear map $ : 5^ —>■ is positive 

or not. The linear map is uniquely determined by 

(3.1) B{x,y) := y'^‘^{xx'^)y, 

a bi-quadratic form in x := (xi,..., Xp) and y := ( 1 / 1 ,..., yq). To check the posi¬ 
tivity of $, it is equivalent to determine whether or not B{x,y) is nonnegative on 
x^x = = 1. So, we consider the optimization problem 

r brain ■= min B{x, y) 

\ s.t. x^x = 1, y^y = 1. 


(3.2) 






POSITIVE MAPS AND SEPARABLE MATRICES 


7 


The first order optimality condition for (I3.2|l implies that 

2Xix 

2 A 2 ?/ 

In the above, Bx{x,y) (resp., By{x,y)) denotes the gradient of B{x,y) in x (resp., 
y). Since B{x, y) is a quadratic form in both x and y, it holds that 

2B{x,y) 

2B{x,y)_ ■ 

Thus, (13.31) and (13.41) imply that 

Ai = A 2 = B{x,y). 


(3.4) 


x^Bx{x,y) 


y'^By{x,y) 



(3.3) 


Bx{x,y) 

By{x,y) 


Note that {x*,y*) is optimal for (13.2|) if and only if (±a;*, ±?/*) are all optimal. By 
choosing the right signs, (133) always has an optimizer {x*,y*) satisfying 

ijx* >0, l^y*>0. 

Therefore, (13.21) is equivalent to the optimization problem 


(3.5) 


min B(x,y) 
s.t. x'^x = 1, 2 /^ 2 / = 1, 

< Bxix.y)-2B{x,y)x = 0, 

By(x,y) - 2B{x,y)y = 0, 

Ijx > 0, 1^2/> 0. 


It is a polynomial optimization problem of degree 5. Compared with (13.2p . the 
problem (13.51) has two main advantages: 

• The problem (13.51) has two more equalities 


Bx{x, y) - 2B{x, y)x = 0, By{x, y) - 2B{x, y)y = 0. 

By using them, Lasserre’s hierarchy of semidefinite relaxations (see (13.71) 1 
has finite convergence. This is shown in Theorem 13.21 However, without 
using them, Lasserre’s hierarchy of semidefinite relaxations for solving (3.2) 
directly may not have finite convergence. 

• The problem (13.51) has two more inequalities. The number of minimizers of 
(13.51) is only one quarter of those of (13.21) . Thus, in computations (e.g., by 
software GloptiPoly 3[T3]), solving (13.51) is often much easier than solving 
(13.2L for numerical reasons. This is because it is easier for GloptiPoly 3 
to identify convergence by using the flat extension condition (see (13.101) 1. 

The optimal value hmin of (13.51) is equal to that of (13.21) . Let h,g be the tuples 
of constraining polynomials in (13.51) : 


i h = (^x'^x-l,y'^y- 

1, Bx{x,y) - 2B{x,y)x, By{x,y) - 2B{x,y)y'j 

[9 = {^pX, l-gV)- 



Lasserre’s hierarchy [16] of semidefinite relaxations for solving (|3.5p is 

6^,^^ := min {B,w) 

s.t. {l,w) = 1, lI^\w) = 0, 

Mk{w) h 0, L^^\w) h 0, 

yj g 


(3.7) 
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for the orders fc = 3,4,_ The product (,) is defined as in (12.6p . We refer to ()2.7I1 

and (1^ for matrices Mk{w), and Lg'^\w). They are all linear in w. The 

dual problem of (13.71) is 


(3.8) 


:= max 
s.t. 


1 

B — 'y € l2k{h) + Qk{g)- 


In the above, the notation l2k{h) and Qk{g) are respectively defined as in (12.21) and 
(EH). By the weak duality, it holds that for all k 

(3.9) 

As in [16], and are both monotonically increasing. 

A practical question is how to check the convergence of and to bmin- 
The following rank condition, for some t G [2, fc]. 


(3.10) rank Mt (w* )= rank Mt+i(w*) 

is a proper stopping criterion (cf. mm)- If (13.101) is satisfied, then = bmin 
and we can get r := rankMt(w*) global minimizers of (13. 5|) . This can be seen as 
follows. From (13.101) . by Theorem 1.1 of |S] (also see [TU [53] for elaborations), we 
can get the decomposition 


w*\2t = Cl[(Ml,-!;i)]2t H-1- Cr[{Ur,Vr)]2t, 

where each Ci > 0 and uf Ui = vf Vi = 1. The equality (l,w*) = 1 leads to 


Cl + • • • + c,. — 1. 


Since w* is an optimizer of (13.71) . the above decomposition of w*\ 2 t implies 

b^f^^ = CiB{ui,Vi) H-h CrB{Ur,Vr)- 

Since bmin < B{ui,Vi) for each i, (|3.9I) shows that 

b^k'’ < B[ui,Vi)m ■ ■ ,b^k'^ < B{Ur,Vr). 

By the above, we can get that 

^min — B{ui,Vi) = ■■■ = B{Ur,Vr) = b]^^ < ^min ■ 

So, b^f^^ = bmim and (ui,ui),..., (ur,Vr) are global minimizers of (13.51) . 


Algorithm 3.1. (Check positivity of a linear map $ : 5^ —>■ S'^.) Formulate the 
bi-quadratic form B{x,y) as in ()3.1|) . Let k := 3. 

Step 1 Solve the semidefnite relaxation (13.71) for a minimizer w*’^. 

Step 2 If (13.101) is satisfied for some t € [2, k], go to Step 3; otherwise, let k := k+1 
and go to Step 1. 

Step 3 Compute r := rankMt(r(;*) global minimizers for (13.51) . Output as 
the minimum value bmin of (|3.2|) . If bmin > 0, then $ is a positive map; 
otherwise, it is not. 


In Step 3, the method in m can be applied to get global minimizers for (13.51) . 
The convergence of Algorithm 13.II is summarized as follows. 


Theorem 3.2. Let B{x, y) be the bi-quadratic form for a linear map ^ ^ 

as in mu, and let bmin be the optimal value of Let b^k\b^^'^ be the optimal 

values as in CT-HJ). Then we have: 








POSITIVE MAPS AND SEPARABLE MATRICES 


9 


(i) For all k sufficiently large, it holds that 


^( 1 ) _ ^( 2 ) _ ^ 


Hence, is positive if and only if >0 (or ^ Oj for some k. 

(ii) Assume iS.Sl) has finitely many minimizers. If k is large enough, then for 
every optimizer w* of \3. 7p there exists t G [2, A:] satisfying \3.10\) . 


Proof, (i) The optimality condition (13. is equivalent to that 


ranki?(x, 2 /) = 2, where B(x,y) 


Bffix,y) X 
By{x,y) 0 


0 

y 


Let (fi,... ,<j)j be the all 3-by-3 minors of B(x, y) and h be the tuple 
h := {x'^x - 1 , y'^y - 1 , (/)i,..., fj). 

Then (13.21) is equivalent to the optimization problem 

(3.11) min B{x,y) s.t. h{x,y)=0. 

Lasserre’s hierarchy of semidefinite relaxations for solving (13.111) is 

f min {B,w) 

(3.12) < s.t, {l,w) = 1, L^^\w) = 0, 

[ Mfe(w) ^ 0, IP G 

for fc = 3,4,.... Its dual optimization problem is 
T(2) 

o), := max 7 

s.t. B-"f G hkih)+ T,[x,y] 2 k- 
By Theorem 2.3 of [22], for all k big enough, we have 

5(1) _ 5(2) _ ^ . 

— ^min- 

That is, both { 6 ^^^} and { 6 ^^^} have finite convergence to bmin- Consider the 
optimization problem 



(3.14) 


min B(x,y) s.t. h{x,y)=0. 


Lasserre’s hierarchy of semidefinite relaxations for (13.141) is 

{B,w) 


Of. ;= min 


(3.15) 


s.t. {l,w) = 1, =Q, 

Mk{w) hO,wG 


Its dual optimization problem is 
(3.16) I 


7 

B G hkih) + Y;[x,y]2k- 


The feasible sets of (13.111) and (I3.14|) are same. By Theorem 3.1 of [55], the sequence 
{bj.'} also has finite convergence to bmin- Since T,[x,y] 2 k ^ Qk{g), we have 

bf < bf < < bm^n 

for all k. Hence, both {5^^^} and have finite convergence to bmin- Thus, by 

(O, $ is positive if and only if for some k, b^^ > 0 or > 0 . 
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(ii) In the above, we have shown that and have finite convergence 

to bmin- For k sufficiently large, 

{B,W*)=bi^^ =bl^^=brmn- 

Because the feasible set of (13.71) is contained in that of (13.151) , w* is also a minimizer 
of (13.151) when k is big enough. Note that, for large k, 



Since b ^}'^, b]^'^ are respectively the optimal values of (13.151) - (13.161) . there is no duality 
gap between (j3.15p and (13.161) . when k is large. Let 

dh := max(l, \deg{h)/2']). 

Note that (13.151) - (13.161) are relaxations for solving (I3.14|) . By the assumption in the 
item ii), we know that (I3.14|) has finitely many optimizers. By Theorem 2.6 of |23) . 
for k big enough, there exists t G [2, /c] such that 

rankMt(ri;*) = renikMt+dhiw*). 

On the other hand, it always holds that 

rankMt(ri;*) < TankMt+iiw*) < rankMt+dhiw*). 

So, ()3.10|) must be satisfied when k is sufficiently large. □ 

4. Decomposition of separable matrices 

This section discusses how to check whether a matrix is separable or not. We first 
formulate the question as a special truncated moment problem, and then propose 
a semidefinite algorithm for solving it. 

4.1. An equivalent reformulation. Recall the matrix space as in (ED 

and the separable matrix cone as in dUD- As shown in Dahl et al. [6l The¬ 
orem 2.2], every separable matrix in S^p-'^ is a nonnegative linear combination of 
rank-1 Kronecker products like 

{uu^) (8) {vv'^), 

where u^u = v^v = 1. By choosing the right signs, the above u,v can be chosen 
such that 

ljit>0, l^u>0. 

An advantage for using the above inequalities is that the software GloptiPoly 3 
has better numerical performance for solving the semidefinite relaxation (I4.11L 
than the one without such inequalities. Moreover, using them may help us get 
shorter S-decompositions. 

Denote the set 

(4.1) A":=|(x,y)eRPxR9 

Therefore, A G A^P’^ if and only if 

N 

A = ^ Cs{UsU^) 8> {vsv'f) 

S = 1 


x^x = l,y^y = 1 , 1 
ljx>0, l^y>0 /■ 


(4.2) 
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for Cl,..., CAT > 0 and (mi, z;i),..., (mat, vn) G K. The equation (I4.2|l is called an 
S-decomposition of A. The above is equivalent to that 

N 

(4-3) ^,r(i,i).7r(fe,0 = '^Cs- {Us)i{Vs)j{Us)k{Vs)l 

S^l 

for all pairs j), (kj) G [p] x [q], with 

'■= (i - !)<? +j, 7r(fc,0 := (fc - l)q + l. 

Let fj, be the weighted sum of Dirac measures: 

(4-4) /i . 4“ * * * T , vn )' 

Then, (14.211 is equivalent to 

A^{i,j),7T{k,i)= XiyjXkyidfi V(i,j),(fc,/) e [p] X [g], 

J K 

which is then equivalent to that 

(4.5) ^ = / ® 

Jk 

Denote the monomial set 

(4.6) £ = {xiyjXkyi : I < i < k < p,l < j < I < q} ■ 

The cardinality of £ is 

-p{p+l)q{q + l), 

the dimension of the space . The monomial xiyjXkyi can be uniquely identified 
by the tuple {i,j^k,l) G £1, as in (11.11) . Therefore, we can index each matrix 
A G equivalently by monomials in £ as 

^XiyjXkVl ■— 

So, each A G can be uniquely identified by the vector {Ab)bGS- Let 

(4.7) a := {Ab)bee- 

The vector a is an ^-truncated multi-sequence (S-tms). We refer to [25] for such 
structured truncated moment problems. 

If there exists a Borel measure supported in K satisfying (14.5L then A must 
be separable. This can be implied by Proposition 3.3 of [53]. Such y is called a 
it'-representing measure for a. 

Summarizing the above, we get the proposition. 

Proposition 4.1. For each A G , the matrix A is separable (i.e., A G 
if and only if is satisfied by a Borel measure y supported in K. 

The vector a, as in ()4.7|) . is an f-tms of degree 4. By Proposition HT] to check 
if A is separable or not is equivalent to detecting if a has a representing measure 
supported in K. The latter is a truncated moment problem. Let 

(4.8) h-={x'^x-l,y'^y-l), 5 := (ijx, l^y). 

Suppose uj G is an extension of a, i.e., w\s = a. If a; is flat with respect to 

h = 0 and g > 0, i.e., it satisfies 

(4.9) P^\ui) = 0, L^p{uj) F 0, rankMt_i(a;) = rankMt(w), 
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then there exist Ci > 0, {ui,Vi) G K (i = 1,..., r) such that 

(4.10) LU = Ci[{ui,Vi)]2t H-1- Cr[{Ur,Vr)]2t- 

The extension condition wjf = a and ()4.10l) imply that 

a = Ci[{ui,Vi)]s H-h Cr[{Ur,Vr)]e- 

From (14.71) . we can get 

A = Cl{uiUi) ® (viVi) + • • • + Cr{UruJ) ® {VrV^). 

This gives an S-decomposition for A if w is flat. Such w is called a flat extension of 

a. 

If there exists a flat extension of a, then A is separable. Conversely, if A is 
separable, then a must have a flat extension (cf. [25l Prop. 3.3]). When does a 
have a flat extension? If yes, how can we find one? If no, how do we know its 
nonexistence? We propose semidefinite relaxations for solving such questions. 


4.2. A semidefinite algorithm. By ProDOsition l4.ll a matrix A £ is sepa¬ 
rable if and only if the vector a, as in (14.711 . has a representing measure supported 
in K. This can be detected by solving semidefinite relaxations. 

Choose a generic SOS polynomial R G T,[x,y\^. Let h,g be as in (14.81) . For 
relaxation orders > 3, consider the semidefinite relaxation 


(4.11) 


mm 

s.t. 


{R,w) 

w\e = a, L^^\w) = 0, w G 


',yh 


Mk{w) > 0, Lf\w) > 0. 

(See (|2.6I) for the product (,).) The dual problem of (14.111) is 


(4.12) 


J max (/, a) 

\ s.t. R-f G hkih)+ Qkig), f GspanlS}. 


The decision variable in (14.1211 is the vector of coefficients of /. 


Algorithm 4.2. (Check membership in the cone For a given matrix A G 

do the following: 

Step 0 Choose a generic R G E[x,y]6. Let k = 3. 

Step 1 If (14.111) is infeasible, then A is not separable and stop; otherwise, solve it 
for a minimizer w*’^. Let t = 2. 

Step 2 Let uj := w*’^\ 2 t- H it satisfies (I4.9|l . go to Step 4; otherwise, go to Step 3. 
Step 3 If t < /c, set t := t -I-1 and go to Step 2; otherwise, set fc := fc -I- 1 and go to 
Step 1. 

1 1 

Step 4 Compute > 0 and (ui,Vi) G K. Let each ai = cfui,bi = c^Vi. Output 
the S-decomposition of A as 

r 

A = ^(uiof) (g) (kb[). 

In Step 0, we can choose a random matrix G of length and then let 

[x,y]I{G'^G)[x,y]3. 

Step 1 is justified by Theorem 14.31 In Step 4, the method in Henrion and Lasserre 
[l4] can be used to compute a and {ui,Vi). Indeed, Algorithm 14.21 can be easily 
implemented by the software GlotpiPoly 3 [13]. 
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In Step 2, we need to check the rank condition in (j4.9p . In numerical computa¬ 
tions, sometimes it may be difficult to determine matrix ranks. This is a classical 
question in numerical linear algebra. A common practice is to evaluate the rank as 
the number of singular values larger than a threshold (e.g., 10“®). We refer to the 
book [8] for how to evaluate matrix ranks numerically. 

4.3. Convergence of the algorithm. First, we study how to detect that A is 
not separable. 

Theorem 4.3. Let A € and a = A\s as in Then we have: 

(i) If is infeasible for some k, then A is not separable, i.e., A^ . 

(ii) If A ^ then is infeasible when k is big enough. 

Proof, (i) Suppose otherwise A G Then there exist unit vectors {ui,Vi) G K 

such that 

a = y^^c^[{ui,Vi)]e 

with all Ci > 0. For all k > 3, the tms 

W = y^^Ci[{ui,Vi)]2k 

i 

is feasible for (14.111) . which is a contradiction. 

(ii) When A is not separable, there exists a nonnegative bi-quadratic form 
Bi{x,y) such that {Bi,A) < 0, by Proposition 12.11 For e > 0 small and B 2 = 
Bi -I- e{x^x){y^y), we still have (i? 2 , A) < 0. Note that B 2 {x,y) is strictly positive 
on K. By Putinar’s Positivstellensatz (cf. [28]), there exists ko such that 

B 2 G l2ko {h) + Qkoig)- 

Clearly, for all r > 0, we have 

R-t{-B 2) & hkoih) + Quo^g), 

{T{-B 2 ),a) = t{-B 2 ,A) - 1-00 

as r —>■ - 1 - 00 . This shows that —B 2 is an improving direction for (14.121) . Thus, 
(I4.12P is unbounded from above, and (14.111) must be infeasible, for fc > /cq. □ 

Second, we prove the asymptotic convergence of Algorithm 14.21 

Theorem 4.4. Let A G and a be as in ( [TK - For a generic polynomial 

R G Yi[x,y]Q, we have: 

(i) For all k > 3, the relaxation 14-11^ has an optimizer w*’^. 

(ii) For all t sufficiently large, the truncated sequence {w*’^\ 2 t} is bounded and 
all its accumulation points are flat extensions of a. 

Proof. When A G the tms a = Ajf admits a representing measure supported 

in K. 

(i) A generic R G 'F[x,y\e, lies in the interior of E[x,y]e. The conclusion can be 
implied by Proposition 5.1(i) of |5S]. 

(ii) The set is contained in the ball -I- < 2. The conclusion can be 

implied by Theorem 5.3(i) of |5S]. □ 
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Third, we investigate when Algorithm |421 converges within finitely many steps, 
i.e., when the stopping condition (j4.9|) is satisfied for some k. Indeed, under some 
general conditions, the hnite convergence occurs. This is verified in all our numerical 
experiments. 

Let be the cone of all polynomials that are nonnegative on the set K as 

in grj. Consider the optimization problem 

(4.13) max (/,a) s.t. i? — / G / G span{£l}. 

Denote by int(S[x, yje) the interior of Ti[x,y\Q. 


Theorem 4.5. Let A G and a be as in Suppose R G yje) and 

f* is a maximizer of Assume that f := R — f* G I{h) + Q{g) and f has 

finitely many eritical zeros on x'^x = y"^y = 1. For all k sufficiently large, if w*’^ 
is a minimizer of then the eondition must be satisfied. 

Proof. When R G int(E[a;, j/Je), the feasible set of (14.121) has an interior point. By 
Proposition 5.1 of [25], the optimization problems (I4.11|) and (I4.12|) have equal 
optimal values. By the assumption, there exists fci such that 


/ G hkiih) + Qkiig)- 

Note that I 2 k{h) + Qk{g) C for all k. Hence, for all k > ki, f* is a maximizer 

of (14.121) . and 

{A,ic*’^) = (r,a) = {r,«;*’^). 

Then, 

(/,w*.fc)=0 Vk>ki. 

Since / G hki {h) + Qkiig), f is nonnegative on K. The dual problem of (|4.13l) is 


(4.14) min {R, z) s.t. z\s = a, zGi%e{K). 

(The symbol S^e{K) denotes the closed convex cone of vectors in that admit 

representing measures supported in AT.) The strong duality holds between ()4.13l) 
and (14.141) . because R G int(E[a;,yje). Since A G a admits a representing 

measure supported on AT, so (14.141) must have a minimizer (say, z*). Let /i be a 
AT-representing measure for z*, then, 

0 = {R, z*) - ir, a) = (/, z*) = I fdg. 


This implies that the minimum value of / on K is zero. 

Consider the polynomial optimization problem: 

(4.15) min f{x) s.t. h{x) = 0, g{x) > 0. 

X 

The k-th order SOS relaxation for (14.151) is 

(4.16) /i,fc:=max 7 s.t. f - ^ € hkih) + Qk{g)- 
Its dual problem is 


(4.17) 


{ / 2 ,fe := min 

W 

s.t. 


(A w) 

(l,ty) = l,Mk{w) F 0, 
L[^\w) = 0,Lf\w)hO- 
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Since / S hki {h) + Qki (g), we have /i,fe > 0 for all k > ki. On the other hand, the 
minimum value of / on itT is 0, so /i,fe < 0 for all k. Hence, 

/i,fc=0 Vfc>fci. 

Lasserre’s hierarchy for (14.151) has finite convergence. The problem (I4.16|) achieves 
its optimal value for k > ki, because / G l 2 ki [h) + QkAg)- 

When (w*’^)o = 0, then veciVf'- Mk{w*’^)vec{\) = 0, and Mk{w*’^)vec{\) = 0 
because Mk{w*’^) ^ 0. (Here vecQ denotes the coefficient vector.) Moreover, we 
have Mk{w*’^)vec{z°‘) = 0 for all |a| < /c — 1 (cf. [501 Lemma 5.7]). So, for A: > 3, 
w *’^|4 is flat. 

When (w*’^)o > 0, there exists r > 0 such that (tw*’^)o = 1. Let w* = 

Then w* is a minimizer of (|4.17|1 . because {f,'w*) = 0 for all k > ki. By the 
assumption, / has finitely many critical zeros on = y^y = 1, so Assumption 2.1 
in [53] for (I4.15P is satisfied. By Theorem 2.2 of [53], w* has a flat truncation w*| 2 t 
if k is big enough, and so is w*’^. □ 

If a polynomial a is nonnegative on A', then we often have a G I{h) + Q{g)-, 
under some general conditions (cf. [24]). For instance, this is the case if the stan¬ 
dard optimality conditions (constraint qualification, second order sufficiency, strict 
complementarity) hold. These optimality conditions are generically satisfiable (cf. 
[24]). So, the assumption f € I{h) + Q{g) in Theorem 14.51 is often satisfied. Thus, 
Algorithm 14.21 typically has finite convergence. In all our numerical experiments, 
the finite convergence always occured. 

4.4. A comparision. We would like to make a comparison between Algorithms l3.1l 
and 14.21 By ProDOsition l2.ll the positive map cone and the separable matrix 
cone are dual to each other. One may expect that their memberships can 

be checked in similar ways. However, these two algorithms have slightly different 
properties for checking the memberships of and ^p^i. For every linear map 
<I>, Algorithm 13.11 is able to determine whether $ belongs to S^P’’^ or not, within 
finitely many steps (cf. Theorem 13.21 111. 

In the constrast, for the cone we have a slightly weaker conclusion. For a 

matrix if A ^ then Algorithm 14.21 is able to verify A ^ within 

finitely many steps (cf. Theorem 14.3l iill. However, if A G Algorithm 14.21 is 

able to get an S-decomposition asymptotically (cf. Theorem 14.4l iill. 

However, Algorithm 14. 21 has finite convergence, under some additional conditions 
(cf. Theorem 14.5p . Interestingly, such conditions are generally satisfied (see the 
comments after the proof of Theorem l4.51) . In other words, Algorithm [42] is almost 
always able to check the membership of within finitely many steps. This was 

confirmed in our numerical experiments. 

A mathematical reason for the above difference is as follows. To test positive 
maps. Algorithms 13.11 can make use of the optimality condition (|3.3|) . However, to 
test separable matrices, there is no such a convenient condition to use for Algo¬ 
rithm 14.21 This is why checking separable matrices is often harder than checking 
linear positive maps. 

At the moment, we are not able to prove that Algorithm 14.21 always have finite 
convergence for all matrices A G . However, no matrices were found such that 
Algorithm 14.21 fails to terminate after a finite number of steps. To the best of the 
authors’ knowledge, this is an open question. 
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5. Numerical Examples 

In this section, we present some examples for checking positivity of linear maps 
and separability of matrices. The computation is implemented in 64-bit MATLAB 
R2012a, on a Lenovo Laptop with Intel(R) Core(TM)i7-3520M CPU@2.90GHz 
and RAM 16.OG. Algorithms 13.11 and 14.21 can be implemented by the software 
GloptiPoly 3 [13], which calls the SDP solver SeDuMi [30]. In the computation, 
the rank of a matrix is numerically evaluated as the number of its singular values 
that is bigger than 10“®. For computational results, only four decimal digits are 
displayed, for cleanness of the presentation. 


fxiyi\ 

T 

/ 

0.0058 

-0.1894 

-0.2736 

0.3415 \ 


(xiyi\ 

xiy 2 



-0.1894 

-0.1859 

-0.1585 

0.0841 


xiy 2 

X 2 yi 



-0.2736 

-0.1585 

-0.0693 

-0.0669 


2^2 2/1 

\x2y2) 


V 

0.3415 

0.0841 

-0.0669 

0.2494 ^ 


\x2y2) 


5.1. Checking positivity of linear maps. 

Example 5.1. ([121 Example 5.1]) Consider the linear map $ : —>■ 5^ such that 


y^^{xx^)y = 


By solving the semidefinite relaxation (13.71) with fc = 3, we get the optimal value 
of (13.21) bjnin = —0.3157, as well as a minimizer {x*,y*) 

((0.9830, -0.1835), (0.4632, 0.8863)). 

This linear map is not positive. The consumed computational time is around 0.8 
second and the rank of the moment matrix is 1. 

Example 5.2. ([^S] §4]) Consider the linear map $ : 5^ ^ such that 
y'^^{xx'^)y = xl{yl+Ayiy2+12y2)+xiX2i^yl+l&yiy2+‘2y2)+xlil2yl+2yiy2+2yl). 

By solving the semidefinite relaxation ()3.7I) with fc = 3, we get the optimal value 
of (13.2p bmin = 0.5837 and an optimizer 

((0.9946, -0.1040), (0.9946, -0.1040)). 

This linear map is positive. The computational time is around 0.7 second and the 
rank of the moment matrix is 1. 

Example 5.3. f |311 Example 4.1]) Consider the linear map $ : —>■ 5^ such that 

y'^^{xx'^)y = ^ fijkiXiyjXkXi, 

where the coefficients fijki satisfy the symmetric pattern 

fijkl — fklij — fkjil — filkj 
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and are given as 


/nil 

= -0.9727; 

/1112 

= 0.3169; 

/1113 = ■ 

-0.3437; 

/1121 = 

= 0.3169; 

/ll22 

= 0.6158; 

/1123 = 

= -0.0184; 

/1133 = 

0.5649; 

/1211 = 

-0.6332; 

/l212 

= 0.7866; 

/1213 

= 0.4257; 

/1222 = 

0.0160; 

/1223 = 

= 0.0085; 

/l233 

= -0.1439; 

/l311 

= 0.3350; 

CO 

to 

II 

-0.9896; 

/l313 = 

-0.4323; 

/l322 

= -0.6663; 

/l323 

= 0.2599; 

/1333 = 

0.6162; 

/22II = 

= 0.7387; 

/22I2 

= 0.6873; 

/2213 = 

= -0.3248; 

/2222 = 

0.5160; 

/2223 = 

-0.2160; 

/2233 

= -0.0037; 

/23II = 

= -0.7986; 

/23I2 = 

-0.5988; 

/2313 = 

-0.9485; 

/2322 

= 0.0411; 

/2323 

= 0.9857; 

/2333 = 

-0.7734; 

/33II = 

= 0.5853; 

/33I2 

= 0.5921; 

/3313 

= 0.6162; 

/3322 = 

-0.2907; 

/3323 = 

-0.3881; 

/3333 

= -0.8526; 







Algorithm 13.11 with 

fc = 3, 

we get the 

optimal value of (13.21) bmin 

= -2.3197, 


and a minimizer [x*,y*): 

((-0.3496, -0.4003, 0.8471), (-0.5017, 0.5383, 0.6772)). 

This linear map is not positive. The computational time is around 3 seconds and 
the rank of the moment matrix is 1. 


Example 5.4. ([21]) Consider the linear map 4) : 5^ — >■ 5^ such that 

y'^<P{xx'^)y = xlyl + xlyl + + 2[xlyl + xlyl + x^yl) 

-2{xiX2yiy2 + xixsyiys + X2X3y2y3). 

By solving the semidefinite relaxation (13.71) with fc = 3, we get the optimal value 
of (lOl bmin = 0 and 3 minimizers: 

(( 0 , 1 , 0 ),( 1 , 0 , 0 )), (( 0 , 0 , 1 ), ( 0 , 1 , 0 )), (( 1 , 0 , 0 ),( 0 , 0 , 1 )). 

This linear map is positive. The convex relaxation in |21| is not tight for checking 
positivity of this map. The computational time is around 5 seconds and the rank 
of the moment matrix is 3. 


Example 5.5. Consider the linear map 4> : 5^ 5^ such that 


y’^<^{xx’^)y 


E 

l<i<fc<4,l<j<Z<4 


XjyjXkyi 

i + j + k + l' 


By solving the semidefinite relaxation (13.71) with fc = 3, we get the optimal value 
of (13.21) bmin =0.0175 and also a minimizer: 


((-0.0565, -0.1415, -0.5192, 0.8410), (-0.0565, -0.1415, -0.5192, 0.8410)). 


This linear map is positive. The computational time is around 116 seconds and the 
rank of the moment matrix is 1. 


5.2. Numerical examples of decomposition of separable matrices. 


Example 5.6. ([H] Example 5.1]) Consider the matrix in 


0.4691 0.1203 

0.1203 0.0309 

-0.1203 -0.0309 
0.4691 0.1203 


-0.1203 0.4691 

-0.0309 0.1203 

0.0309 -0.1203 
-0.1203 0.4691 


The semidefinite relaxation (14.111) is infeasible for fc = 3, so ^ is not separable, i.e., 
A ^ The computational time is around 1 second. 
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Example 5.7. Consider the matrix A = Ai + 2 A 2 — ^A^ in /C^’^ where 

Ai = (eief) (g) (eief) + (e2e|’) (g) (626^) + (eaef’) (g) (eae^’), 

A2 = (eief) (g) (e2e|’) + (e2ef’) (g (eael’) + (eaef’) (g) (eief), 

^3 = (eief + e 2 ef) (g (6162 + 626^) + (eie|’+ eaef) ® (eiCg + eaef) 

+ (6263' + ^362) <g (caef’ + e2e|’). 

One can check that {A, {xx^) (g {yy^)) is the polynomial in Example 15.41 The 
semidefinite relaxation (14.111) is infeasible for fe = 3, so A is not separable, i.e., 
A ^ . The computational time is around 6 seconds. 

Example 5.8. Consider the matrix A € /C^’^ such that 

A(i-l)q+j,(k-l)q+l = i+ j + k + l 

for all 1 < i,j, k,l < A. The semidefinite relaxation (14.111) is infeasible for fc = 3, so 
A is not separable, i.e., A ^ xhe computational time is around 56 seconds. 

Example 5.9. Consider the following matrix A in the space 


A = 

'2 1' 
1 3 

0 

■ 3 -1 -1' 

-1 3 -1 

-b 

■ 1 -1 

-1 2 

0 




-1 -1 3 





It is separable. By Algorithm 14.21 we got an S'-decomposition A = O 

(bibf), where (oi, bi) are listed column by column as follows: 


1.2078 

1.0746 

-1.0379 

1.2993 

1.1104 

-1.3520 

0.5378 

1.3514 

0.9620 

1.6754 

-1.2993 

1.6509 

1.4560 

1.6012 

0.1118 

0.5916 

0.9481 

1.6192 

1.6265 

-0.6348 

0.7998 

1.2220 

0.7327 

1.0439 

0.5969 

-0.9708 

1.4657 

1.0804 

-1.3338 

-1.0924 

-1.3767 

0.6311 

-0.6086 

1.1818 

1.0229 


The computational time is around 3 seconds, and the rank of the moment matrix 
is 7. 

Example 5.10. Consider the following matrix A in the space 

A = /a (g /a + (eief) (g (eae^) + (e2e^) 0 (6363) + (eae^) 0 (eief). 

It is separable. By Algorithm 14.21 we got an S'-decomposition A = ® 

{bibj), where (oi, bi) are listed column by column as follows: 


0.3332 

0.2690 

1.0893 

0.6254 

-0.7835 

0.4637 

0.2487 

0.7692 

0.3514 

-0.8466 

-0.2597 

0.5751 

0.3076 

0.6064 

-0.6125 

-1.2164 

-0.6846 

0.5776 

-0.8295 

-1.2005 

0.4759 

0.1940 

0.3639 

0.4472 

0.5247 

0.3001 

0.2107 

0.6835 

0.0702 

0.1801 

-0.4733 

0.1722 

-0.1736 

0.4736 

0.6881 

-0.0122 

0.5405 

0.7896 

0.1044 

0.3527 

-0.3512 

-0.7737 

-0.0089 

0.3060 

-0.6107 

-0.9697 

0.3689 

0.5320 

0.4306 

0.5356 

0.6862 

-0.1301 

0.7654 

0.8684 

0.0262 


0.1275 

-0.5190 

-0.1012 

0.4497 

0.1233 

0.6715 

0.8565 


0.0838 

0.4547 

0.3925 

0.6624 

0.7719 

-0.1016 

0.6082 


-0.2720 

-0.5632 

-0.7107 

-1.1051 

0.7074 

-0.1978 

0.5716 


0.5406 

0.5401 

0.8189 

0.4488 

0.5923 

0.6990 

0.0517 


-0.2686 

0.0231 

-0.1082 

0.6563 

0.0799 

0.5970 

0.7607 



The computational time is around 7 seconds, and the rank of the moment matrix 
is 15. 

In the following, we consider some randomly generated separable matrices. 
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Example 5.11, Consider the following matrix A in the space 

5 

A = ^{u^uJ)®{vivJ), 

i=l 

where (mi, tii),..., (ms, V 5 ) are given column by column as 


1.2058 

0.9072 

1.7107 

-0.5053 

0.4015 

-0.7758 

-0.4990 

1.2737 

-0.7534 

0.7230 

-0.8226 

-1.6610 

0.0580 

1.6702 

-1.6482 

0.8679 

-0.7584 

-2.0588 

0.0188 

-1.1817 

0.4465 

0.6656 

-2.5623 

-0.0524 

-1.0712 

0.4539 

-0.1715 

0.3518 

0.6462 

0.6615 

1.1036 

0.0342 

-1.1263 

0.7462 

0.5727 


Clearly, A is separable. By Algorithm l4.21 we got an S'-decomposition A = 
{bibf), where {ai,bi) are displayed column by column as follows: 


-0.3476 

-0.6388 

-1.1734 

-0.3886 

2.0908 

-0.5183 

0.3514 

0.7547 

-0.6988 

1.5567 

1.1491 

1.1697 

0.8008 

1.5939 

0.0709 

0.0274 

1.0770 

0.8920 

1.2222 

1.6845 

-0.0761 

-0.9452 

0.4591 

1.1077 

2.0965 

0.9396 

0.2435 

0.4662 

-0.6839 

-0.2878 

1.0850 

-0.0486 

1.1338 

-0.5919 

0.9215 


The computational time is around 53 seconds, and the rank of the moment matrix 
is 5. The computed ^-decomposition is same as the input one, up to a permutation 
and scaling of 0 ^, 6 ^. That is, there exist real numbers Tij^ with i = 1,..., 5 and 
j = 1 , 2 such that each \Ti^iTi^ 2 \ = 1 and 

In the above, the permutation vector cr = (3, 2, 5,1,4). 

Example 5.12. Consider the matrix in the space 

6 

where (ui, ui),..., {u^, vg) are given as as 


-1.6002 

1.5428 

-1.3328 

-0.5149 

0.1403 

0.6616 

1.3773 

1.0162 

-0.4031 

0.8267 

-0.4983 

-0.2561 

-1.8003 

-2.2759 

-0.4736 

1.1673 

1.9594 

1.0980 

1.1086 

0.9578 

-1.5677 

0.9943 

0.6987 

-0.6716 

-0.2947 

0.8312 

-0.3316 

-0.3028 

-1.7391 

-1.4154 

-0.6738 

1.0141 

0.0581 

0.2061 

-0.3607 

1.4899 

-0.3373 

-0.3853 

-1.8798 

-1.1994 

-0.5071 

0.2920 

0.6769 

1.1913 

-0.9375 

-0.9701 

-0.2439 

-0.0425 


Clearly, A is separable. By Algorithm l4.21 we got an S'-decomposition A = )® 

{bibj), where {ai,bi) are displayed column by column as follows: 


0.9455 

0.7853 

1.1724 

0.1316 

-0.4819 

1.3463 

-0.8138 

-0.3040 

0.7722 

-0.4675 

0.7737 

0.4072 

1.0637 

1.3033 

-1.7295 

1.8381 

1.0925 

0.4784 

-0.6550 

-0.7972 

0.7278 

0.6555 

0.9306 

1.5836 

0.4988 

-1.1925 

1.0938 

1.8538 

0.3235 

0.3283 

1.1403 

1.2552 

1.3345 

0.3845 

-0.2202 

-0.0575 

0.5709 

0.2460 

-0.5070 

0.5406 

1.2815 

1.8609 

-1.1456 

-0.0358 

1.5677 

0.2600 

1.0365 

0.9281 


The computational time is around 110 seconds, and the rank of the moment matrix 
is 6 . The computed S-decomposition is same as the input one, up to a permutation 
and scaling of 0 ^, 6 ^. That is, there exist real numbers Tij^ with i = 1,..., 6 and 
j = 1 , 2 such that each \Ti^iTi^ 2 \ = 1 and 
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In the above, the permutation vector a = (1, 3, 6, 5,4, 2). 

5.3. Remark, We would like to discuss the relationship of this paper to an earlier 
work on bi-quadratic optimization. Ling et al. |21) proposed some convex relax¬ 
ations for bi-quadratic optimization, and proved their approximation bounds. The 
relaxations in [21] might not be tight (cf. Example 15.4p . but provided worst case er¬ 
ror bounds. In contrast, the hierarchy of semidefinite relaxations constructed in this 
paper is always tight for checking positive maps, as well as for solving bi-quadratic 
optimization. This is proved in Theorem 13.21 Moreover, this paper also discusses 
how to check separability of matrices and how to compute S-decompositions, which 
are not the main subjects of the work [21] . 
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